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Distributed Convex Optimization of Time-Varying Cost Functions 
with Swarm Tracking Behavior for Continuous-time Dynamics 

Salar Rahili, Wei Ren, Sheida Ghapani 


Abstract —In this paper, a distributed convex optimization 
problem with swarm tracking behavior is studied for continuous¬ 
time multi-agent systems. The agents’ task is to drive their 
center to track an optimal trajectory which minimizes the sum 
of local time-varying cost functions through local interaction, 
while maintaining connectivity and avoiding inter-agent collision. 
Each local cost function is only known to an individual agent 
and the team’s optimal solution is time-varying. Here two cases 
are considered, single-integrator dynamics and double-integrator 
dynamics. For each case, a distributed convex optimization 
algorithm with swarm tracking behavior is proposed where each 
agent relies only on its own position and the relative positions 
(and velocities in the double-integrator case) between itself and 
its neighbors. It is shown that the center of the agents tracks 
the optimal trajectory, the the connectivity of the agents will be 
maintained and inter-agent collision is avoided. Finally, numerical 
examples are included for illustration. 

I. Introduction 

Flocking or swarm tracking of a leader has received signifi¬ 
cant attention in the literature Q-0- The goal is that a group 
of agents tracks a leader only with local interaction while 
maintaining connectivity and avoiding inter-agent collision. A 
swarm tracking algorithm is studied in [iTJ, where it is assumed 
that the leader has a constant velocity and is a neighbor 
of all followers. The result in [jl | has been extended in © 
for the leader with a time-varying velocity, where it requires 
the leader to be a neighbor of all followers too. In 0, a 
swarm tracking algorithm via a variable structure approach is 
introduced, where the leader is a neighbor of only a subset of 
the followers. In the aforementioned studies, the leader plans 
the trajectory for the team and no optimal criterion is defined. 
However, in many multi-agents applications it is relevant for 
the agents to cooperatively optimize a certain criterion. 

In the distributed convex optimization literature, there exists 
a significant interest in a class of problems, where the goal is 
to minimize the sum of local cost functions, each of which is 
known to only an individual agent. Recently some remarkable 
results based on the combination of consensus and subgradient 
algorithms have been published 0-@- For example, this 
combination is used in |4| for solving the coupled optimiza¬ 
tion problem with a fixed undirected topology. A projected 
subgradient algorithm is proposed in |5j|, where each agent 
is required to lie in its own convex set. It is shown that all 
agents can reach an optimal point in the intersection of all 
agents’ convex sets for a time-varying communication graph 
with doubly stochastic edge weight matrices. 
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However, all the aforementioned works are based on 
discrete-time algorithms. Recently, some new research is 
conducted on distributed optimization problems for multi¬ 
agent systems with continuous-time dynamics. Such a scheme 
has applications in motion coordination of multi-agent sys¬ 
tems. For example, multiple physical vehicles modelled by 
continuous-time dynamics might need to rendezvous at a 
team optimal location. In 0, a generalized class of zero- 
gradient sum controllers for twice differentiable strongly con¬ 
vex functions with an undirected graph is introduced. In |8|, 
a continuous version of © is studied, where it is assumed 
that each agent is aware of the convex solution set of its 
own cost function and the intersection of all these sets is 
nonempty. In the convergence rate and error bounds of 
a continuous-time distributed optimization algorithm has been 
derived. In (B an approach is given to address the problem 
of distributed convex optimization with equality and inequality 
constraints. A proportional-integral algorithm is introduced in 
where |12]| considers strongly connected weight 
balanced directed graphs and 1131 extends these results using a 
discrete-time communications scheme. A distributed optimiza¬ 
tion problem for single-integrator agents is studied in 1141 with 
the adaptivity and finite-time convergence properties. 

Having time-invariant cost functions is a common assump¬ 
tion in the literature. However, in many applications the local 
cost functions are time varying, reflecting the fact that the opti¬ 
mal point could be changing over time and creates a trajectory. 
In addition, in continuous-time optimization problems, the 
agents are usually assumed to have single-integrator dynamics. 
However, a broad class of vehicles requires double-integrator 
dynamic models. In our early work 1151, a preliminary attempt 
for time-varying cost function is made. However, in all articles 
on distributed optimization mentioned above, the agents will 
eventually approach a common optimal point. While the 
algorithms can be applied to rendezvous problems, they are 
not applicable to more complicated swarm tracking problems. 

In this paper, we study a distributed convex optimization 
problem with swarm tracking behavior for continuous-time 
multi-agent systems. There exist significant challenges in the 
study due to the coexistence of nonlinear swarm behavior, 
optimization objectives, and time-varying cost functions under 
the constraints of local information and local interaction. The 
center of the agents will track an optimal trajectory which min¬ 
imizes the sum of local time-varying cost functions through 
local interaction. The agents will maintain connectivity and 
avoid inter-agent collision. Each local cost function is only 
known to an individual agent and the team’s optimal solution 
is time-varying. Both cases of single-integrator dynamics and 






double-integrator dynamics will be considered. 

The remainder of this paper is organized as follows: In 
Section [II] the notation and preliminaries used throughout this 
paper are introduced. In Section [HI] and |IV[ two distributed 
convex optimization algorithms with swarm tracking behav¬ 
ior and time-varying cost functions for respectively single¬ 
integrator and double-integrator dynamics are designed. Fi¬ 
nally in Section [V] numerical examples are given for illustra¬ 
tion. 


Lemma 2.3: G 3 The symmetric matrix 

Q S 
S T R 

is positive definite if and only if one of the following 
conditions holds: (i) Q > 0, R — S T Q~ 1 S > 0; or (ii) 
R>0,Q- SR~ 1 S t > 0. 

Assumption 2.2: The function fo(x, t) is m-strongly convex 
and continuously twice differentiable with respect to x, \/x, t. 


III. Time-Varying Convex Optimization with 

II. NOTATIONS AND PRELIMINARIES SWARM TRACKING FOR SINGLE-INTEGRATOR DYNAMICS 


The following notations are adopted throughout this paper. 
R + denotes the positive real numbers. I denotes the index 
set {l,...,iV}; The transpose of matrix A and vector x are 
shown as A T and x T , respectively. ||x|| p denotes the p-norm 
of the vector x. Let l n and 0„ denote the column vectors of n 
ones and zeros, respectively and I n denote the n x n identity 
matrix. For matrix A and B, the Rronecker product is denoted 
by A®B. The gradient and Hessian of function / are denoted 
by V/ and H, respectively. The matrix inequality A > (>)B 
means that A — B is positive (semi-)definite. 

Let a triplet Q = (V, £, A) be an undirected graph, where 
V = {1,..., N} is the node set and £ C V x V is the edge set, 
and A = [a,;,-] £ rNxn j s a we ighted adjacency matrix. An 
edge between agents i and j, denoted by (i,j) £ £, means 
that they can obtain information from each other. The weighted 
adjacency matrix A is defined as an = 0, and a,j = aji > 0 
if (i,j) £ £ and = 0, otherwise. The set of neighbors of 
agent i is denoted by Ni = {j £ V : (j, i) £ £}. A sequence of 
edges of the form (i,j),(j,k),..., where i,j 7 k £ V, is called 
a path. The graph Q is connected, if there is a path from every 
node to every other node. The incidence matrix associated with 
the graph Q is represented as D. Let the Laplacian matrix 
L = [lij\ £ R NxN associated with the graph Q be defined as 
hi = a ij and hj = for * ^ j ■ The Laplacian 


matrix L is symmetric positive semidefinite. We denote the 
eigenvalues of L by A].... .A .y. The undirected graph Q is 
connected if and only if L has a simple zero eigenvalue with 
the corresponding eigenvector ljv and all other eigenvalues 
are positive [16]. When the graph Q is connected, we order 
the eigenvalues of L as Ai = 0 < A 2 < ... < An- Note that 
L = DD t . 


Lemma 2.1: 0 Let f(x) : R m —> f? be a continuously 
differentiable convex function. f(x) is minimized if and only 
if V/ = 0. 

Definition 2.1: Jl7| f{x) is m-strongly convex if and only 
if 


(y - x)(X7 f(y) - V/(at)) > m \\y - ar|| 2 , 


for to > 0, Vx, y £ R n ,x ^ y. If f(x) is m-strongly convex 
and twice differentiable on x, then II(x) > ml n . 

Lemma 2.2: |l 81 The second smallest eigenvalue A 2 of the 
Laplacian matrix L associated with the undirected connected 
graph Q satisfies A 2 = min x T llv=0iX#0jv 


Consider a multi-agent system consisting of N physical 
agents with an interaction topology described by the undi¬ 
rected graph Q. Suppose that the agents satisfy the continuous¬ 
time single-integrator dynamics 

±i(t)=Ui(t) ( 1 ) 

where x l (t) £ R m is the position of agent i, and ztj(f) £ R m 
is the control input of agent i. As xfit) and ufit) are functions 
of time, we will write them as x. t and u, for ease of notation. 
A time-varying local cost function /,; : R m x R + II is 
assigned to agent i £ X, which is known to only agent i. The 
team cost function / : R rn x R + —? R is denoted by 

N 

f{x,t) = Y^fi(x,t). (2) 

i—1 

Our objective is to design Ui for 0 using only local in¬ 
formation and local interaction with neighbors such that the 
center of all agents tracks the optimal state x*(t). and the 
agents maintain connectivity while avoiding inter-agent colli¬ 
sion. Here x* (t) is the minimizer of the time-varying convex 
optimization problem 


x*(t) = arg min f(x,t). 

xGR™ 

The problem defined in ([3j is equivalent to 


N 


min 

Xi{t) 


E 


fi{xi,t) subject 


to Xi = Xj. 


(3) 

(4) 


Intuitively, the problem is deformed as a consensus problem 
and a minimization problem on the team cost function (|2j. 

In our proposed algorithm, each agent has access to only its 
own position and the relative positions between itself and its 
neighbors. To solve this problem, we propose the algorithm 


ufit) 


= -<*£ 
jeNi 


dV t , 

dxi 


/?sgn( 

j&Ni 


dV L s 
dxi ^ 


</>i, (5) 


where 

1 A TT—ll Y7 ft A I 9V fi(Xi, t) , 

= (Xi, t) (tV fi[Xi, t) -\ - — -), 

Vij is a potential function between agents i and j to be 
designed, a is non-negative, j3 is positive, and sgn(-) is the 
signum function defined componentwise. It is worth mention¬ 
ing that <f>i depends on only agent i’s position. We assume that 







each agent has a radius of communication/sensing R, where if 
\\x t — Xj\\ < R agent i and j become neighbors. Our proposed 
algorithm guarantees connectivity maintenance which means 
that if the graph £7(0) is connected, then for all t, Q{t) will 
remain connected. Before our main result, we need to define 
the potential function V l:j . 

Definition 3.1: [|3J The potential function V tJ is a differ¬ 

entiable nonnegative function of \\xi — Xj\\ which satisfy the 
following conditions 

1) Vij = Vji has a unique minimum in ||aij — Xj\\ = dij , 
where r/, , is a desired distance between agents i and j 
and R > maxj j dij, 

2) Vij — > oo if j| Xi — Xj || —► 0. 

3) Vu = c, where c is a constant. 

< dV, 


4) 


dVa 


= 0 


Xi( 0) — (0)|| > R, ||Xi — Xj | 

®i(0) - *j(0)|| < R, 


\\Xi - Xj 


> R, 
-¥ R, 


Theorem 3.2: Suppose that graph £7(0) is connected, As- 


W = 


1 


N N 


ij- 


i= 1 3 =1 


The time derivative of W is obtained as 


-4 


N N QTJf 

■ee|£*‘ 

1=1 7 = 1 


[ ®Vij . dVij . \ 

i=i j=i J 

where in the second equality. Lemma 3.1 in (3] has been u 
Now, rewriting W along with the close-loop system 0 
0 we have 

N N „ N N „ 

ECEgl’-oEES 

1=1 j = l 4=1 j=l 

N N „ N , N 

+eeS^e( e 

4=1 7 = 1 4 = 1 


4 = 1 j — 

' dVij 
dxi 


3 = 1 


Vij 8Vi 

57 !g “ ( E 

3 = 1 


) 




A/ - 


AT 


where VFi is positive semi-definite. The time derivative of W\ 
can be obtained as 

N N N r\ 

Wl = (J2 Vfj(Xj,t)) T (£ H 3{ X 3,t)Xj +J2 ^fi(.Xj,t)) 


3 = 1 


3 = 1 


3 = 1 


Because V fi(xj,t) = aXj + giifi), Vi £ X, we know 
Hi(xi,t) = Hj(xj,t) and we obtain 


Wl=(J2^f3^3,t)) T (Hi(Xi,t)) 


3 =1 


( 6 ) 


(J 2 ± j +H < 1 ( X i’ t )^2g t X7 fj{Xj,t)). 

3 = 1 3 = 1 ^ 

Based on Definition 13. 1 1 we can obtain 


dVij 

de x . 


dV 3i 

de Xl 


dVa 

de Xi 


(7) 


sumption 2.2 holds for each agent’s cost function fi{xi(t),t), 
and the gradient of the cost functions can be written as 
V fi( x i,t) = axi + gi(t), Vi £ X. If a > 0, and /? > 

1111 i > Vi £ I, for system ([T} with algorithm (|5j, the center 
of the agents tracks the optimal trajectory while maintaining 
connectivity and avoiding inter-agent collision. 

Proof: Define the positive semi-definite Lyapanov func¬ 
tion candidate 


Now, by summing both sides of the closed-loop system 
GL with control algorithm 0, for i = 1, ...,7V, we have 
E^Li — EyLi Hence we can rewrite (|6| as 


Wi = -r( 


N 


N 


v fj ( x j^)) T (J2 V h ) 

3=1 3=1 

JV 


Therefore, W\ < 0 for E 7 =i ^fj( x j) 7^ 0. This guarantees 


that Eli Vfj(xj) will asymptomatically converge to zero. 


Because V/*( Xi,t) = aXj + gi(t), we have Eli x i = 


~ gjU 93 

i N" 


. On the other hand, using Lemma 


2.1 


we know 


E J= i V fj(x*,t) = 0. Hence, the optimal trajectory is 


which implies that 


E iV 

3=1 

No ; 


l N 


( 8 ) 


(9) 


3=1 


where we have shown that the center of the agents will track 
the team cost function minimizer. ■ 

Remark 3.3: Connectivity maintenance guarantees that 
there exists a path between each two agents i, j £ I Vf. Hence, 


_ 2_ Y N x 

N 2-ij=l x 3 


< (N — 1 )R. Now, using the 


It is easy to see that if (3 > 110* 11 Vi £ I, then W is negative. 
Therefore, having W > 0 and W < 0, we can conclude that 
Vij £ Coo. Since V, :i is bounded, based on Definition 3.1 it 
is guaranteed that there will not be a inter-agent collision and 
the connectivity is maintained. 

In what follows, we focus on finding the relation between 
the optimal trajectory and the agents’ positions. Define the 
Lyapanov candidate function 


we have 

result in Theorem |3.2| it is easy to see that 

\\x*(t) - £j(f)|| < NR,\/i £ X. 

which guarantees a bounded error between each agent’s posi¬ 
tion and the optimal trajectory. 

Remark 3.4: There exists a sufficient condition on the 
agents’ cost functions to make sure that ||0*||x > Vi £ I is 


bounded. If both ||V,/)|| and 
then ||<^j||i Vi £ I is bounded. 


av.fi 

dt 


3=1 


3=1 


Vi, j £ X are bounded. 


Remark 3.5: In Theorem |3.2| it is required that each agent’s 
cost function have a gradient in the form of S7fi(xi,t) = 
oxj + gfit). While this can be a restrictive assumption, there 
exists an important class of cost functions that satisfy this 
assumption. For example, the cost functions that are commonly 

























used for energy minimization, e.g., fi(xi, t) = {aXi+gi(t)) 2n , 
where a € f?, n £ {1, 2,...} are constants and gi(t) is a time- 
varying function particularly for agent i. Here, to satisfy the 
condition ft > Vi £ I, as discussed in Remark 3.4 it is 

sufficient to have a bound on ||< 7 i(f)|| and ||<?i(i)||. 

IV. Time-Varying Convex Optimization with Swarm 
Tracking Behavior For Double-Integrator 
Dynamics 

In this section, we study distributed convex optimization of 
time-varying cost functions with swarm behavior for double¬ 
integrator dynamics. Suppose that the agents satisfy the 
continuous-time double-integrator dynamics 


Xi(t) = Vi{t) 
Vi(t ) = Ui(t) 


( 10 ) 


where Xi,Vi £ R m are, respectively, the position and velocity 
of agent i, and u l £ R m is the control input of agent i. 

We will propose an algorithm, where each agent has ac¬ 
cess to only its own position and the relative positions and 
velocities between itself and its neighbors. We propose the 
algorithm 

^(t) = - Y, S— - a X) ( v * - v o) 

jew* 1 jem 


-P'V] sgn (vi - Vj) + </)i, 


( 11 ) 


jeN, 


where 


= -h; 


L ,d(Nfi(xi,t) <Nfi(xi,t)s 

- ---h 


y dt 


dt 


dt 


-HiVfi(xi,t) + \ H i 1 (x i ,t)(—H i (x i ,t))H i t (x i ,t) 


dt 


,dVfi{x u t) 

y dt 




The potential function V l; j is introduced in Definition ED a 
and ft are positive coefficients. 

Theorem 4.1: Suppose that graph C?(0) is connected. As¬ 
sumption 2.2 holds for each agent’s cost function fi(xi(t),t), 
and the gradient of the cost functions can be written as 
V/ifo.i) = a Xi + 9i (t), Vi £ 1. If ft > ll(n ® / '" ) ^" 2 , 

_ _ yx2(U) 

for system dTOj) with algorithm (|TT]|, the center of the agents 
tracks the optimal trajectory and the agents’ velocities track the 
optimal velocity while maintaining connectivity and avoiding 
inter-agent collision. 

Proof: The closed-loop system ( flQ| with control input 
© can be recast into a compact form as 

X = V 

V = -a(L 0 I m )V - ftDsgn(D T V) 

( Ejeiv, ATT \ (12) 

+ (n® / m )$ 




dVi 


Nj 


j'GiVjv 8 xn 


where X = [x^ , x%, ..., xJ f ] T , and V = [vj , uj,..., v x ] T are, 
respectively, positions and velocities of N agents and <1> = 
[4>\ ,<t>li ■■■AnY■ It is preferred to rewrite Eq. © in terms 
of the consensus error. Therefore, we define exit) = (n 0 
I m )X and e v (t) = (n 0 I m )V, where U = I N - 
Note that n has one simple zero eigenvalue with 1 .y as its 
right eigenvector and has 1 as its other eigenvalue with the 
multiplicity N — 1. Then it is easy to see that ey(t) = 0 if 
and only if Vi = Vj Vi, j £ X. Thus the agents’ velocities reach 
consensus if and only if ey(f) converge to zero asymptotically. 
Rewriting © we have 


e x = 
e v = 




e v 


-a(L 0 I m )ev - ftDsgn(D T e v ) 

/ V 9VlJ \ 
j Z-ijeNi de Xl 

+ (n 0 i m )$, 


Vs. 


jeVjv dex, 


7 


(13) 


where we recall the elements of e x and ey as ex = 
[e^,eT X2 ,...,eT XN ] T and ey = [e^, e\, ..., e£j T Define the 
positive definite Lyapanov function candidate 


N N 


B ' = y£I> 1 


N ■ v + o e V e V- 


i=i j =i 

The time derivative of W along (fl3| can be obtained as 


, V N ~ T 


2 ^7^7 x de Xi 

i=ij=i 

N N dV T 


dV i:i 1 , T . 

€Vz + ~de~ ev J> +e v ev 
X A 


de 


Xi 


e Vi + e V^V 


(14) 


j=l j —1 

= - aey(L 0 Im)ey + e^(n 0 I m )T> 

- ft ey{D 0 J m )sgn((D T 0 I m )e v ), 

where in the first equality. Lemma 3.1 in (3j has been used. 
We also have 

ey(n 0 7 m )$ - ftey(D 0 I m )sgn((D T 0 I m )e v ) 

< ||ey || 2 ||(n 0 J m )$|| 2 -/3||(D t 0 Im)ey\\ l 

/ - (15) 

< ||ey|| 2 ||(Il0/ m )$|| 2 — ft\Jey(DD T 0 I m )e v 

< IMI 2 II (n 0 Im)n 2 - ft 77) IMI 2 , 


where in the last inequality Lemma [2)2] has been used. Now, it 
is easy to see that if ft\J \2 (X) > || (II 0 / m )$|| 2 , then W is 
negative semi-definite. Therefore, having W > 0 and W < 0, 
we can conclude that Vij,e v £ By integrating both sides 
of ( fl4| , we can see that e v £ £ 2 - Now, applying Barbalat’s 
Lemma pO) , we obtain that ey asymptotically converges to 
zero, which means that the agents’ velocities reach consensus 
as t —>■ oo. On the other hand, since V l:l is bounded, based on 
Definition |3.1[ it is guaranteed that there will not be inter-agent 
collision and the connectivity is maintained. 

In what follows, we focus on finding the relation between 
the optimal trajectory of the team cost function and the agents’ 


























states. Define the Lyapanov candidate function 

N N 

Wi = 


3 =1 
N 


N 


3 =1 
N 


N 


(16) 




3=1 3=1 3 = 1 3=1 

where S', = H i ~ 1 {x i ,t){§ i S7 /ifo, t) + V fi(xi,t)). The time 
derivative of W± along the system defined in ([TO]) and © 
can be obtained as 

N N N f) 


3 =1 


j=l 

AT AT 


j=l 


+ (E V 3 - E 5 '3) T (E *3 “ E 


3 = 1 


3=1 3=1 

N 


3 = 1 


^(E^ife’^E^^'^+Ea 7 a ( x 3, *)) 


3 = 1 


J = 1 


J = 1 

N N N N 

+ (E i; 3 - E 5 i) t (E °3 - E -E 

i=i i=i i=i j'=i 

N N N 


= (E V ^3 (*3 > *) ) T (E H i ( X 3 , t) V i + E ^ V h ( X 3 , t ) ) 


3 = 1 


J = 1 


at 


J=1 

N N N 

~ (E^l _ E S '3) T (E fl 3-(®3.*) V /7(®3.*)). 

3 = 1 3 = 1 3 = 1 

where in the second equality, we have used the fact that 
by summing both sides of the closed-loop system ( flQ| ) with 
controller ( fTT| for j = 1,2and using (|7j, we obtain that 

EE *3 = EE ‘Au Because V/i(a: i ,f) = crx*+&(*), Vi e 
X, we know Hfaxi^t) = Hj(xj,t). Hence, we have 

N N N 

Wi = - (E - E SjfiHiix^t) J2 VA(x„ f)) 


j=l 


i=i 


i=i 

AT 


IV / IV -/V rj \ 

+ (E V ^'( a: 3'’ t )) T (^( a: l> t )E t, 3' + E ( 17 ) 

.7 = 1 ' .7 = 1 .7 = 1 ' 


*= - (E V ^"1 (*3 ^)) T (E V A (*3- ,*))• 

3=1 3=1 

Therefore, Wj < 0 for ^E V f 3 {x.j.t) ^ 0. 

Having Wi > 0 and ITj < 0, we can conclude 
that Ylj=i'Vf j {x j ,t),{Yj*= 1 Vi - EE 5 0 e 

. By integrating both sides of I4j = 

we can see that 

'^2j—i^fj{ x j,t) £ C. 2 - Now, applying Barbalat’s Lemma, 
we obtain that Ej=i V/j(^j|t) will asymptomatically 
converge to zero. Now, under the assumption that 

V/i(xj, f) = ax* + &(*), we have Y !\=i ^ = E =1 9j and 


a r V—'iV • 

??• — ^j =1 9j 

2^j =1 ~ a 


On the other hand, using Lemma |2.1| we know 


E Eva (x*,t) = 0. Hence, the optimal trajectory is 


j j =i 


E n 

j =1 * 

X ~ iVcr ’ V 


E at 

3 = 1 9j (18) 


JVff 


Now using (fl8|, we can conclude that 


=t= 


TV 


AT 

EE- 

3 = 1 


* 


_1_ 

]V 


AT 


E Vi 


(19) 


Particularly, we have shown that the average of agents’ state, 
positions and velocities, tracks the optimal trajectory. We also 
have shown that the agents’ velocities reach consensus as t —► 
oo. Thus we have v % approaches v* as t —> oo. This completes 
the proof. ■ 


Remark 4.2: The assumption /3 > i n The¬ 


orem 


4.1 can be interpreted as a bound on the differ¬ 


ence between the agents’ internal signals. This condition is 
weaker than putting an upper bound on fa. If |V fj — V/,||, 


dt 


dV.fi 

dt 


and 


yy/j 


dt 2 


yy/i 

dt 2 


Vi,j £ X are bounded, 
then || (n ( 8 ) I m )<&\\ 2 is bounded. For example, the cost func¬ 
tion fi(xi(t),t) = ( axi(t)+gi(t)) 2n introduced in Remark 3.5 
will satisfy these conditions if \\gi{t) — gjit )||, \\gi(t) — ijjit )|) 
and ||gi(f) — are bounded. 


V. Simulation and Discussion 

In this section, we present two simulations to illustrate the 
theoretical results in previous sections. Consider a team of 
six agents. We assumed that R = 5, which means that two 
agents are neighbors if their this distance is less than R. The 
agents’ goal is to have their center minimize the team cost 
function Ei=i /». t) where Xi(t) = (r Xi (t),r yi (t)) T is 
the coordinate of agent i in 2D plane. 

In our first example, we apply algorithm ([5]) for single¬ 
integrator dynamics <0- The local cost function for agent i 
is chosen as 


fi(xi(t),t ) = (r Xi (t) - isin(0.2t)) 2 + (r Vi (t) - *cos(0.2f)) 2 , 

( 20 ) 

For local cost functions Assumption |2.2| and the con¬ 
ditions for agents’ cost function in Remark |T4l hold and the 
gradient of the cost functions can be rewritten as V/i(xj, t ) = 
aXi + g, (t). To guarantee the collision avoidance and connec¬ 
tivity maintenance, the potential function partial derivatives is 
chosen as Eqs. (36) and (37) in |3), where fa j = 0.5 VL j. 
Choosing the coefficients in algorithm 0 as a = 2,(3 = 5, 
and r = 1, and the results are shown in Fig. |T| 

In our next illustration, the swarm control algorithm © 
is employed for double-integrator dynamic system © to 
minimize the team cost function where the local cost functions 
are defined as 


fi(xi(t),t) = (r Xi (t) + 2i ) 2 + (j. yi ft) + j s in(0. It )) 2 , (21) 

In this case, the parameters of control algorithm © are 
chosen as a = 10 and /3 = 20. Fig. [2] shows that the center 
of the agents’ positions tracks the optimal trajectory while the 
agents remain connected and avoid collisions. 
























Fig. 1. Trajectories of all agents along with optimal trajectory using algorithm 
|5j for local cost function (20) 



Fig. 2. Trajectories of all agents using algorithm {FT) for local cost function 
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VI. Conclusions 

In this paper, a distributed convex optimization problem 
with swarm tracking behavior was studied for continuous-time 
multi-agent systems. The agents’ task is to drive their center to 
minimize the sum of local time-varying cost functions through 
local interaction, while maintaining connectivity and avoiding 
inter-agent collision. Each local cost function is known to 
only an individual agent. Two cases were considered, single¬ 
integrator dynamics and double-integrator dynamics. In each 
case, a distributed algorithm was proposed where each agent 
relies only on its own position and the relative positions 
(and velocities in double-integrator case) between itself and 
its neighbors. Using these algorithms, it was proved that for 
both cases the center of agents tracks the optimal trajectory 
while the connectivity of the agents was maintained and agents 
avoided inter-agent collision. 
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